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METHOD AND APPARATUS FOR ENCODING A PRODUCT CODE 

This invention relates to a method of encoding a 
product code and an apparatus therefor. 

It is known that on communication channels, errors 
occur randomly and in bursts. Random error correcting 
codes or single burst error correcting codes are either 
inefficient or inadequate and it is, therefore, desired 
to produce codes which are capable of correcting random 
errors and/or single or multiple bursts. 

A known technique is to use an in ter leaver with a 
so-called product code which is formed by, for example, a 
two-dimensional code C x C y/ where C x is a linear code of 
overall lengch n x bits formed of k :< data bits and having 
n : . : -k :< parity bits. The other linear code C y has overall 
length n y bits and is formed of k y data bits and n y -k y 
parity bits. The linear code C :< C y is formed such that 
each cede vector is a rectangular array of n :< columns and 
r. y rows in which every row is a code vector m C x and 
every column is a code vector in C y . Such a two- 
dimensional code is called a direct product of C x and C y . 
A three-dimensional code may be additionally formed 
having linear code bits C 2 , comprising k z data bits, n z -k 2 
parity bits and overall length n 2 bits . Such codes are 
described in "Error Control Coding: Fundamentals and 
Applications" by Lin and Costello, published by Prentice 
Hail Inc. at page 274. The same work also describes 
encoding of cyclic codes at page 95 thereof. 

Turbo codes are also known in which two encoders 
generate parity symbols from two recursive convolutional 
codes, each with a small number of states. The data bits 
are typically transmitted uncoded . An interleaver 
permutes the original data bits before being applied to a 
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second encoder. The permutation allows that input 
sequences, for which one encoder produces low weight code 
words, will usually cause the other encoder to produce 
high weight code words. Thus, even though the 
constituent codes are individually weak, the combination 
is extremely powerful. 

Turbo codes and turbo product codes allow good 
performance to be achieved by the employment of an 
iterative decoding algorithm using simple decoders which 
are individually matched to the constituent codes. Each 
constituent decoder sends a posteriori likelihood 
estimates of the decoded bits to another decoder and uses 
the corresponding estimates from another decoder as a 
P riori likelihoods. The noisy encoded information bits 
15 from the channel are available to each decoder to 

ihTtialise" "the^a "priori likelihoods . The turbo (product) " 
decoder iterates between the outputs of the constituent 
decoders for a number of iterations, such that the final 
decoded output is a hard quantized version of the 
likelihood outputs of one of the decoders. 

A two-dimensional product code, which may be a turbo 
product code, is constructed by arranging an incoming 
data stream into a rectangular matrix of size k x columns 
by k y rows. Parity bits from a systematic code are 
25 calculated from each row of data to provide an array of 
size n x by k y . Parity bits are then calculated from each 
column of the horizontal encoded array to give a turbo 
product code encoded array of size n x by n y . The element 
encoded bits are then read out and passed to a channel 
30 for transmission. In a three-dimensional array, the 
array would be of size n x n y n z . 

A known turbo product code encoder is made by A.H.A. 
Inc. under type number 4501 IC, which comprises a 
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processing core connected to RAM. Data arriving at the 
input of the encoder is stored in a memory. Once all the 
data bits for a block are present, encoding of the block 
commences. Parity bits are calculated by the encoder 
5 core. Only when all the parity bits have been calculated 
and the block is complete may the values be read out. 
The overall latency of such a design for a code with 
n x =n y =64 and k x =k y =57 is 5, 678 clock cycles. Thus, the 
latency, i.e. the number of clock cycles between applying 

10 data and reading out encoded data is lengthy. It may be 
considered that shortening the code would reduce the 
latency, but shortening the code is extremely difficult 
with the known architecture. If it is desired to shorten 
either the horizontal (x) and/or vertical (y) codes, it 

15 is necessary to insert zeros into the input stream to pad 
out""tM"¥ataTrray and then to remove the zeros from the' 
encoded stream before passing the data to the 
transmission channel. 

Additionally, because of the complexity of the 

20 decoder at a receiver, the systematic codes from which 
the turbo product code parity bits are generated are 
restricted to very simple extended Hamming codes. 

The present invention seeks to provide a method of 
encoding a product code, which may be a turbo product 

25 code, which may be constructed from any convenient- 
systematic block code in which the systematic bits occur 
in order, i.e.- using not only Hamming codes, but also 
other types of systematic block codes. These might be 
other binary block codes, for example, low density parity 

30 check codes, but as will be understood by those skilled 
in the art, it is possible to construct product • codes 
based on codes which are based upon higher order Galois 
Fields instead of Hamming codes which are 1 based on GF(2) . 



So as to produce Hamming codes, exclusive OR gates in an 
encoder perform addition modulo 2. Such a function is 
referred to by mathematicians as GF(2) arithmetic. Code 
exist which operate by taking as the sum modulo some 
other power of 2, e.g. 4, 8, 256. Such codes operate on 
individual data elements which are larger than a single 
binary digit, e.g. the (255, 239) Reed - Solomon Code 
which operates on bytes and corrects 8 or less erroneous 
bytes out of 255 (regardless of the number of bits in 
error in each erroneous byte) . The encoder for such a 
code takes 239 bytes and appends 16 parity bytes using- a 
similar, but more complex, structure than the Hamming 
encoder. The. present invention is also applicable to 
such encoders . 

According to a first aspect of this invention there 
is provided a method of encoding "a product "code having" a 
first dimension systematic block code of length n x 
elements and a second dimension systematic block code of 
length n y elements including the steps of: 

(a) applying a data element stream to first 
dimension encoder means to produce said first 
dimension systematic block code having k x data 
elements and n x -k x parity elements, where said 
parity elements are derived from said k x data 
elements, 

(b) repeatedly applying said data element stream t 
said first dimension encoder means to produce 
first dimension code vectors, where k y is the 
data element length of the second dimension 
systematic block code, 

(c) as each one of said k y first dimension code 
vectors is produced, outputting said first 
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dimension code vectors to second dimension 
encoder means representative of n x encoders, 

(d) deriving (n x n y -n x k y ) parity elements for said 
second dimension systematic block code vectors, 

5 and 

(e) outputting second dimension code vectors as 
each, is produced so as to provide said encoded 
product code . 

Preferably, said product code is a turbo product 

10 code. 

In an embodiment, said second dimension encoder 
means comprises n x encoders each producing a total of n y 
second dimension encoded elements from k y input data 
elements or first dimension parity elements. 

15 Because such an embodiment requires a large number 

of encoders, in a preferred" embodiment /said first 
dimension systematic block code is applied in sequence to 
said second dimension encoder means and said second 
dimension encoder means includes a parity generator 

20 having a random access memory { RAM) associated therewith 
thereby repeatedly clocking data and parity elements in 
to an out of said RAM to synthesize said n x encoders. 

Preferably, said systematic block code is a Hamming 
code and, advantageously, an extended Hamming code. In 

25 such an embodiment, said data element is a single binary 
bit but, in an alternative embodiment, said data element 
has a length of two or more binary digits. 

Advantageously, said first dimension encoder means 
includes a Hamming parity generator provided to produce 

30 said parity elements of said first dimension systematic 
block code and, preferably, also includes an extended 
Hamming parity generator adapted to receive output from 
said Hamming parity generator to produce an ' extended 



6 



10 



Hamming parity element for said first dimension 
systematic block code. 

• Conveniently, said second dimension encoder means 
includes a further Hamming parity generator connected to 
receive output from said extended Hamming parity 
generator so as to produce said parity elements of said 
second dimension systematic block code and, preferably, 
said second dimension encoder means also includes a 
further extended Hamming parity generator adapted to 
receive output from said further Hamming parity generator 
so as to produce said encoded product code. 

■ Advantageously, the output counter value of a first 
dimension counter having a range 0 to n x _l is applied to 
control signal generator means which supplies a clocking 
15 signal to a second dimension counter having a range 0 to 
n y -l,. and 'said control "signal" generator means applies 
control signals to said first and second dimension 
encoder means according to the output values of both of 
the aforesaid . counters . 
20 According to a second aspect of this invention there 

is provided an apparatus for producing a product code 
having a first dimension systematic block code of length 
n x elements and a second dimension systematic block code 
of length n y elements, said apparatus including first 
25 dimension encoder means for receiving a data element 
stream to produce therefrom said first dimension 
systematic block code having k x data elements and n x -k x 
parity elements, where said parity elements are derived 
from said k x data elements, said first dimension encoder 
means being arranged to produce k y first dimension code 
vectors, where k y is the data element length of the second 
dimension systematic block code, and second dimension 
encoder means representative of n x encoders, said second 
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dimension encoder means being arranged to receive said 
first dimension code vectors as they are produced and 
deriving (n x n y -n x k y ) parity elements for said second 
dimension systematic block code, whereby said second 
5 encoder means is arranged to output second dimension code 
vectors as each is produced so as to produce said encoded 
product code . 

Preferably, said product code is a turbo product 

code . 

10 In an embodiment, said second dimension encoder 

means comprises n x encoders each producing a total of n v 
second dimension encoded elements from k y input data 
elements or first dimension parity elements. 

In a preferred embodiment, said second dimension 

15 _ encoder means includes a parity generator having a RAM 
assocTat"ed Therewith / "whereby said first dimension 
systematic block code is applied in sequence to said 
parity generator and control signal generator means are 
provided for repeatedly clocking data and parity elements 

20 in to and out. of said RAM so that n x encoders are thereby 
synthesized . 

Preferably, said systematic block code is a Hamming 
code and, advantageously, an extended Hamming code. In 
such an embodiment, said data element is a single binary 

25 digit but, in an alternative embodiment, said data 
element has a length of two or more binary digits. 

Advantageously, said first dimension encoder means 
includes a Hamming parity generator provided to produce 
said parity elements of said first dimension systematic 

30 block code and, preferably, said first dimension encoder 
also includes an extended Hamming parity generator 
adapted to receive output from said Hamming parity 
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generator so as to produce an extended Hamming parity 
element for said first dimension systematic block code. 

Conveniently, said second dimension encoder means 
includes a further Hamming parity generator connected t 
receive output from said extended Hamming parity 
generator for producing said parity elements of said 
second dimension systematic block code and, preferably, 
said second dimension encoder also includes a further 
extended Hamming parity generator adapted to receive 
output from said further Hamming generator so as to 
produce said encoded product code. 

Advantageously, the output counter value of a first 
dimension counter having a range 0 to n x _l is applied to 
control signal generator means which supplies a clockinc 
signal to a second dimension counter having a range 0 tc 

n y -l, and said control signal generator means" applies 

control signals to said first and second dimension 
encoder means according to the output values of both of 
the aforesaid counters. 

The invention will now be described, by way of 
example, with reference to the accompanying drawings, in 
which : 

Figure 1 shows, in schematic form, a manner of 
operation of the present invention utilising a two- 
dimensional encoded array, 

Figure 2 shows an apparatus for producing a two- 
dimensional turbo product code in accordance with this 
invention, 

Figure 3 shows, in block schematic form, a Hamming 
parity generator used in an embodiment, of this invention 

Figure 4 shows, in block schematic form, a Hamming 
generator for generating an extended parity bit, 
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Figure 5 shows, in block schematic form, a preferred 
embodiment of an apparatus in accordance with this 
invention, and 

Figure 6 shows, in schematic form, a manner of 
5 control logic generation used in this invention. 

In the Figures like reference numerals denote like 
parts . 

An embodiment of the invention will now be described 
in relation to the use of Hamming codes where bits are 

10 employed, but it is to be understood that the invention 
is applicable also to other more complex types of code 
where, instead of bits, bytes are used so that the term 
"bit", as used in the description of the preferred 
embodiment, is in a general case, synonymous with 

15 "information element", which may be data or parity. 

Referring to Figure l, "a data element iripiit""stream~ 1 
comprising data bits d Q , d x , . . . d kxxy -i is applied to an 
encoding matrix 2 having constituent codes C x and C y . The 
first dimension code C x is formed by k x data bits forming 

20 first dimension data vectors from which first dimension 
parity vectors are computed having n x -k x parity bits. 
These parity bits are appended to the data bits to give 
an overall code length of n x bits . Similarly, the array 
in a second dimension has code C y formed of k y data bits 

25 forming second dimension data vectors and second 

dimension parity vectors formed by n y -k y parity bits, and 
overall length n y bits. A two-dimensional array is shown 
in Figure 1 but it will be understood that a three- 
dimensional array having a third dimension code C z may be 

30 provided and such an array is intended to be within the 
scope of this invention. 

Data is applied in horizontal rows starting from the 
top left corner of the array, horizontal parity vectors 
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evaluated and data is read out from the matrix row by 
row, as shown by the data output 3. Thus, in a preferred 
embodiment, data in a first row (d 0 to d kx -l) is read out 
followed by parity elements associated with that row ( Po 
to Pnx-kx-i) before reading out data elements from the next 
row (d kx to d 2kx _ 1 ) and the parity elements associated 
therewith (p nx - kx to p 2n x-kx)-i). The matrix is filled and 
sequentially read out, as shown in Figure 1, until k y 
first dimension code vectors have been read out, 
whereupon vertical parity is evaluated and read out. It 
will be appreciated that vertical parity for the column 
commencing with data bit d 0 may be evaluated, as soon as 
data bit d (ky _ 1)kx has been added to the matrix. The 
process of evaluating vertical parity and reading out the 
vertical parity continues until the last parity bit P n . <ny . 
kxky-i is ' read out . 

It is to be understood that for applications of the 
invention where the transmission channel has no memory, 
such as satellite links, the order in which the bits are 
read out is not important. However, for the purposes of 
designing an encoder, the memory requirement is minimised 
if the bits are read out in a row by row order starting 
with the top row. 

Referring to Figure 2, data at input terminal 11 is 
applied to an encoder 12 for a first dimension, for 
example, for the horizontal code C x having length n x 
elements. The encoder 12 may be a single extended 
Hamming encoder to be described in more detail 
hereinbelow. 

Output from encoder 12 is applied to a 
routing/switching device 13 which does not contain memory 
and output from the- device 13 is applied to a first 
encoder 14, a second encoder 15 ... n x encoder 16 for the 
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second dimension, e.g. n x encoders for the vertical 
dimension code C y having bit length n y . An output from 
each of the encoders 14-16 is applied to a further 
routing/switching device 17 which provides a turbo 
5 product encoded output to output terminal 18 for onward 
data transmission . 

The encoders 12, 14-16 and devices 13, 17 are 
controlled by control logic 19 which also produces a 
control data output applied to terminal 20. 
10 Thus, for a two-dimensional turbo product code, the 

architecture of the present invention comprises one 
encoder for a first dimension n x , k x , and n x encoders for 
the n y , k y (second) dimension, i.e. one encoder for each 
column . 

15- - The overall latency, for the present invention is the 

combined latency of "both" tfieT encoder for the first 
dimension and the encoder for the second dimension, e.g. 
the encoder 12 and one of the encoders 14 . An extended 
Hamming code may be implemented with a delay of only, two 

20 clock cycles of one dimension. Thus, the overall latency 
of the present, invention is only four clock cycles for a 
two-dimensional array whatever the n, k parameters for 
the Hamming codes that may have been chosen. 

Where a turbo product code of dimensions (64, 57) by 

25 (64, 57) is required, the latency improvement over the 
prior art is 99.93%. Moreover, with extended Hamming 
codes, the present invention may be readily parameter ised 
to allow shortening of either or both codes to an n-s, k- 
s code simply by changing the maximum value of the 

30 counters to be described hereinbelow with reference to 
Figure 5 . 

In the arrangement of Figure 2 it is to be 
understood that only a two-dimensional product code 
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generation apparatus is shown, but a 'three-dimensional 
apparatus may be implemented by applying outputs from the 
device 17 to (n x n y ) , n z , k z encoders for a third 
dimension. Output from each of the encoders of the third 
dimension would then be applied to a further 
routing/switching device for output. It is to be noted 
that although data input may not be continuous, data 
output at terminal 18 may be continuous because data is 
read according to the data input control at terminal 20. 

A Hamming parity code generator is shown in Figure 3 
having a data input terminal 31, a gate input terminal 
32, state in terminals 33, state out terminals 34 and a 
parity out terminal 35. 

The generator shown in Figure 3 is for a Hamming 
code of size up to and including n=63, k=57, where the 
"length n of the Hamming code is one less ■ than the total 
number of data bits in the complete (extended Hamming) 
code and k is the number of data bits k x in the complete 
code. The generator has an input data XOR gate 36 
providing parity out signals to terminal 35 and to a 0 
input of a multiplexer 37, the 1 input of the -multiplexer 
37 being connected to signal level 0. The multiplexer 37 
is controlled by signals at the gate terminal 32. An 
output of multiplexer 37 is passed to an input of each of 
six AND gates 38, the other input of each AND gate being 
connected to an appropriate coefficient g 0 to g 5 which 
represent a polynomial from which the Hamming code is 
constructed. Output from the AND gate 38 connected to 
coefficient 9o is provided to a first memory element b 0 
and. the delayed output from memory element b 0 is provided 
via terminals 33, 34 to an input of an XOR gate- 39 and 
thence to a second memory element b x . The output of the 
AND gate associated with coefficient 9l is also provided 
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to the input of XOR gate 39. The output of the second 
memory element bi is applied to an associated output 
terminal 34, thence via an input terminal 33 to an XOR 
gate 39 associated with multiplier g 2 , and so on as shown 
5 in Figure 3 . 

In operation, a user specifies the polynomial of the 
code to be generated and the bits of coefficients go-gs 
are set accordingly. For example, the polynomial x 6 +x + l 
would have generating bits for multipliers set as 
10 follows: 

g 0 =l, gi=l, 92=0 , g 3 =0, g 4 = 0, g 5 =0 

Such a polynomial is appropriate for a Hamming code 
n=63, k=57 . For a code with fewer parity bits, e.g. 
n=31, k=26, a different polynomial would be used, e.g. 
15 x 5 +x+l. In such a case, the bits of the coefficients 
could be generated as follows: " — 

go=0, gi=l, g 2 =l, g3=0, g 4 =0, g 5 =0 

At start up, the memory elements b 0 -b 5 have a 0 
state . 

20 The operation of the multiplexer 37 is such that 

when the gating signal applied at terminal 32 is 0, the 
multiplexer outputs the signal that is presented at its 0 
input terminal. When the gating signal is 1, the 
multiplexer outputs the signal at its 1 input, i.e. 0. 

25 Assuming coefficients go=l, gi=i, gi , gs=0, then 

with the multiplexer 37 gate input set at 0, the value of 
the first bit of data d 0 at terminal 31 is passed through 
multipliers associated with coefficients g 0 and gi so that 
the value of the first bit is loaded into memory elements 

30 b 0 and bi . When the next data bit di is applied to input 
terminal 31 and is passed to memory element b 0 , memory 
element bi now contains data bits do+di, and memory 
element b 2 contains data element d 0 . This process 
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continues for a total of k cycles, but it will be noted 
that after five cycles, the state of memory element b 5 may 
be 1 or 0 and this value is XORed with the input data. 

Following k cycles of data input, the gate signal of 
multiplexer 37 is set to 1 and the parity generator is 
turned into a simple shift register. Parity is read out 
on successive cycles when data in is set to 0. As each 
data bit is read out, 0's are shifted in so that the 
memory elements b 0 -b 5 each contain 0 after the final 
parity bit is read. 

It is to be noted that because extended Hamming 
codes are used, there will be one cycle for which the 
Hamming parity generator is idle. 

If it is desired to implement a shortened code, e.g. 
n=62, k=56, this can be accomplished by simply clocking 

less data samples ■ — ■•- 

So as to generate an extended Hamming code, the sum 
modulo 2 of all the data and Hamming parity bits in the 
code word are calculated and appended as an extra parity- 
bit. Such a circuit for generating an extended Hamming 
code is shown in Figure 4 in which a Hamming code 
comprising data and Hamming parity bits is applied to an 
input terminal 41. Terminal 41 is connected to an XOR 
gate 42. Output from gate 42 is applied to output 
terminal 4 6 and a 0 input of a multiplexer 4 3 having its 
other,.!, input connected to be supplied with a 0 level. 
The multiplexer 43 is controlled by a gate signal applied 
at terminal 47. Output from the multiplexer 43 is 
provided to a memory element 4 4 which supplies an output 
to another input of gate 42, via terminals 4 9 and 48. 

Thus, the extended parity bit is calculated by the 
generator shown in Figure 4 having a. single memory 
element. Starting, from a memory element 'initial state 
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where b 0 =0, the generator performs an XOR function of the 
incoming bit with the contents of memory element 44. 
This is repeated for ail the data bits and the Hamming 
parity bits, after which the multiplexer 43 is set to 1. 
5 The extended parity generator is read and cleared, ands 
simultaneously passes a valid extended parity bit to 
multiplexer m xe or m ye (described herein below) as 
appropriate . 

A preferred embodiment of a parameterised encoder 

10 for a (64, 57) x (64, 57) two-dimensional turbo product 
code using extended Hamming encoders will now be 
described with reference to Figure 5. 

In Figure 5, date input terminal 11 is connected to 
a 0 input of multiplexer mi, the other, 1, input terminal 

15 of the multiplexer mi being connected to input terminal 51 
for receiving 'a" 0 "level indicative of no data. Output 
from the multiplexer mi is applied to encoder 12 for the 
first dimension which is formed of an extended Hamming 
generator G xh having the architecture shown in Figure 3, a 

20 multiplexer m xh , an extended Hamming generator G xe having 
the architecture shown in Figure 4 and another 
multiplexer m xe - Output from multiplexer mi is applied to 
input terminal 31 of Hamming generator G X h and to the 0 
input of the multiplexer m xh , . the 1 input of multiplexer 

25 m xh being connected to receive input from output terminal 
35. Output from multiplexer m xh is applied to extended 
Hamming generator G xe and to the 0 input of the 
multiplexer m xe , the parity output terminal 4 6 is applied 
to the 1 input terminal of multiplexer m xe - Output from 

30 multiplexer m xe , forming output from the first dimension 
encoder 12, is applied to the second dimension encoder 
arrangement 22 formed by the routing/switching devices 
13, 17 and the second dimension encoders 'l'4-l 6 . The 
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Hamming generator G yh for the second dimension is 
constructed similarly to the Hamming generator G :<h of the 
first dimension and, similarly, the multiplexer m yh is 
connected to receive inputs from the multiplexer G yh . 
The multiplexer m xe is similar to the multiplexer m xh . 
Further, the extended Hamming generator G ye for the second 
dimension is similar to the extended Hamming generator G xe 
for the first dimension and multiplexer m ye connected to 
receive output from the extended Hamming generator G ye . 
The multiplexer m yh is similar to the multiplexer m xe . 
Output from the multiplexer m ye forms the turbo product 
code and is applied to output terminal 52 for use in a 
transmission channel. 

The preferred embodiment of Figure 5, instead of 
requiring n x second encoders utilises random access 
memories' (RAM ) ~~ R yh and R ye . RAM R yh is connected between- 
state out terminal 34 and state in terminal 33. 
Similarly, RAM R ye is connected between state out terminal 
49 and state in terminal 48. By using such an 
arrangement of RAM, the necessity for plural second 
dimension encoders is avoided in practice so that, in 
effect, the plural encoders are synthesized. The control 
logic 17 has a first dimension counter 53 for providing a 
count c x in the counter range 0 to n x -l and a second 
dimension counter 54 for providing a second dimension 
count c y in the counter range 0 to n y -l. The data input 
control terminal 18 is connected to the counter 53 and an 
output of the counter 53 is connected to a control signal 
generation, circuit 55 which provides: control signal Si to 
multiplexer m i; control signal S xh to the Hamming 
generator multiplexer m xh and terminal 32; control signal 
S xe to the extended Hamming generator multiplexer m xe and 
to input terminal 47; control signal r yh to provide a read 
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signal address to RAM R yh and a write signal address w yh to 
RAM R yh ; control signal S yh is applied to Hamming 
multiplexer m yh and to input terminal 32 of generator G v :-; 
a read address signal r ye is applied to RAM R ye and a write 
5 w ye address signal is applied to RAM R ye ; and a control 

signal S ye is applied to extended Hamming multiplexer m ve 
and to input terminal 4 7 of generator G ye • The circuit 55 
also provides an increment signal to increment the second 
dimension counter 54 and receives an output signal 

10 representative of c y from counter 54 . 

The operation of Figure 5 will now be described. 
When the control signals S if S xh , S xe , S yh , S ye are 0, 
the value at the data input terminal 11 is passed to the 
output of the respective, relevant, multiplexer mi, m xh , 

15 m xe , m yh , m ye . When the control signal Si, etc. is 1, the 
value" at input terminal 51, i.e. 0, is passed "to "the 
output of the respective multipliers. When the data 
input control signal applied at terminal 18 is high, e.g. 
i, the counter 53 increases its output count c x by i. If 

20 this causes the count to have a value n x then the count is 
reset to .0. The control signal generation circuit 55 
produces an enabling pulse which is generated from the 
counter 53 count, value c x so that the counter 54 count c y 
is incremented as the count c x reaches the beginning of 

25 each new line and is reset to 0 . 

The action of each of the parity generators G xh , G xe , 
G y h/ G ye is as follows. 

Each parity generator has five terminals, namely, 
input data terminal 31 or 41, output terminal 35 or 46, 

30 control data, i.e. gate, terminal 32 or 47, output state 
terminal 34 or 49 and input state terminal 33 or 48. 
When the gate terminal 32 or 47 is low, the parity 
generator produces an output state from the input state 
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and the input data bit, according to "the internal logic 
of the generator, which embodies the desired code 
determined by a user, e.g. a (64, 57) code or a (32, 26) 
code. When the gate terminal is high, parity bits are 
presented at the relevant parity output terminal 35 or 
4 6. After the parity bits have been read, the output 
state will be all O's so that the parity generator is 
ready for the start of the next code word. 

Each dual port RAM R yh , R ye i s configured to have one 
read port and one write port, the respective read ports 
being controlled by address signals r yh and r ye and the 
respective write ports being controlled by address signal 
w yh and w ye . Data is read out of RAM R yh or R ye via 
terminal 33 or 48 respectively in accordance with a RAM 
address location set by read address signal r yh or r ye 
respectively. Simultaneously, - data " from terminals 34, 4 9 
at a data in port of RAM R yh and R ye respectively is 
written to a RAM memory address set by write address w yh 
or w ye respectively. 

In the preferred embodiment, dual port RAMs are used 
to store the state of the parity generators in the second 
dimension rather than to provide a separate parity 
generator for every column in the two dimensional array. 
Therefore, by storing and fetching, the states for each 
column the effect of an encoder for each of n x columns is 
synthesized, using only one Hamming parity generator and 
one extended parity generator. Thus, a considerable 
reduction in the gate count for a field programmable gate 
array implementation is provided. 

Figure 6 shows the manner by which the control 
signal generation circuit 55 produces the control signals 
Si, S xh , S xe , S. yh , S ye . Thus, for the first row c y =0, 
horizontal count signals c x from 0 to n x -l are produced 
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before moving down the block to the second row c y = 1 , 
etc. until the last row c y = n y -l. 

It will be appreciated by those skilled in the art 
that the values must be delayed in order to take account 
5 of increasing latency in the data path as data moves 
through the data path of Figure 5. 

The read and write addresses are r xh , r xe , w yh , w ye are 
the value of the count c x that has been delayed by an 
appropriate amount so that the correct value of the 

10 encoder state for any column, i.e. the second dimension, 
is presented at the input to the relevant parity 
generator at the correct moment of time, and the results 
of the parity calculation is stored back in the same 
location a short time later, thereby synthesizing the* 

15 desired effect of having plural second dimension 
encoders . 

A step-by-step operation of the embodiment shown in 
Figure 5 will now be described. 

Encoding starts with c x =0, c y =0 and the contents of 
20 RAMs R yh , Rye and internal states of the multiplexers and 
generators are set to 0. 
Time step 1 : 

First data element do is present at the input 11 of 
multiplexer mi. Since Si=0, the data element d Q is passed 
25 to the 0 input of multiplexer m xh and input terminal 31 of 
Hamming generator G xh . 
Time step 2 : 

A second data element di is present on the input 11 
of multiplexer mi- This is passed to the input of 
30 multiplexer m hx and Hamming generator G xh . Simultaneously, 
the first data element is already present on the input of 
multiplexer m xe and is passed to the output of multiplexer 
m xe - At the same time, the state of the Hamming generator 
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G xh is updated and the state thereof is fed directly back 
to the input thereof. 
Time step 3: 

A third data element d 2 is present on the input of 
multiplexer m ± . This is passed to the input of 
multiplexer m xh and Hamming generator G xh . Simultaneously, 
the previous element di is present on the 0 input of 
multiplexer m xe and is passed to the output of multiplexer 
m xe . At the same time, the state of the horizontal (first 
dimension) Hamming generator G xe is updated from the data 
element di - the output state is fed directly back to the 
input of generator G xh . Concurrently, the horizontal 
(first dimension) extended Hamming parity generator G xe 
operates on the data element d 0 . Again, the state 
generated by generator G xe is fed directly back to the 

- input™ of Gx^r. : 

Time step 4 : 

A fourth element. d 3 is present on the 0 'input of 
multiplexer m ± , This is passed to the 0 input of the 
multiplexer m xh and on to the output of m xe . At the same 
time, the state, of the horizontal Hamming generator G xe is 
updated from the data element d 2 - the output state of 
generator G xh is fed directly back, to the input of 
generator G xh . Concurrently, the horizontal extended 
parity generator G xe operates on the data element di and 
the vertical Hamming generator G xh operates on data 
element d 0 . 

Time step 5: ' 

A fifth data element d 4 is present on the 0 input of 
multiplexer m ± . This is passed to the 0 input of 
multiplexer m xh and to the input terminal 31 of generator 
G xh . At the same time, the state of the- Hamming generator 
G xh is updated from the data element d 3 - 'the output state 
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of generator G xh is fed directly back to the input 
thereof. Concurrently, the horizontal extended parity- 
generator G xe operates on the data element d 2 , the 
vertical Hamming parity generator G yh operates on data 
5 element di and the vertical extended parity generator G V5 
operates on data element d 0 . 
Time step 6: 

A sixth data element d 5 is present on the 0 input of 
multiplexer mi. This is passed to the 0 input of 

10 multiplexer m xh and terminal 31 of generator G xh . 

Simultaneously, the previous element is already present 
on the 0 input of multiplexer m xe and is passed to the 
output thereof. At the same time, the state of the 
generator G xh is updated from the data element d 4 - the 

.1.5 . state of the. generator G xh is fed directly back to the 
• input -thereof . Concurrently, the horizontal extended " 
parity generator G ye operates on the data element d 3/ the 
Hamming parity generator G yh operates on data element d 2 
and the vertical extended parley generator G ye operates on 

20 data element di . The first element of the output word, 
data element do, is passed to multiplexer m ye and output 
at terminal 52 . 

The operation continues in similar fashion until 
time step k x , at which point count c x =k x -l, and count c y =0 . 

25 Time step k x +l : 

The control signal Si now has a value of 1 . No data 
is input. Data element d kx ~i is already present on the 
input of multiplexer m xh and is passed to the output 
thereof. At the same time, the state of the horizontal 

30 Hamming generator G xh is updated from the data element d kx 
- the output state of generator G xh is fed directly back 
to the input thereof. Concurrently, the horizontal 
extended parity generator G xe operates on' "the data element 
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di«-i, the vertical Hamming parity generator G yh : operates 
on data element d fcx . 2 and the vertical extended parity 
generator G ye operates on data element d kx _ 3 . Data elemen 
d Kx . 4 is output at terminal 52. 
Time step k x +2 : 

Having compensated for the delay introduced by m lf 
control signal S xh now has the value 1. Parity element P 
is present at the input of multiplexer m xh and the parity 
element is passed through to the output of multiplexer 
m xh . Concurrently, the horizontal extended parity 
generator G xe operates on the data element d kx , the 
.vertical Hamming parity generator G yh operates on data 
element d kh -i and the vertical extended parity generator 
G ye operates on data element d KX _ 2 . Data element d kh . 3 is 
output at terminal 52. 

The operation continues in a similar -fashion" until 
time step n x , at which point c x =n x -l, Cy =0 . Parity 
generator G xh has been cleared by the successive writing 
out of its contents over the preceding time steps. 

Typically, 3 to 7 parity bits may predeterminedly be 

used. 

Time step n x +l : 

At this time c x =0, c y =l.. The encoder now begins 
processing the second row of data whilst the final bits 
of the first row are still being processed. Bit d kx is 
present at the input of mi. 

Time step n x ( k y -l ) + k x : 

All the data for the block has now been input. 
Time step n h k y +6: 

The number 6 denotes the latency of the encoder. 
Parity generators G xh and G xe are idle at n x k y +l . The 
encoder outputs vertical code (second dimension) having 
parity but is still calculating vertical (second 
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dimension) extended parity. The successive clocking out 
of the parity causes the state of the generators G xh , G X2/ 
Gyh/ G ye to be reset, as explained above, with regard to 
Figures 3 and 4 . 
5 Time step n x (n y -l)+6: 

The encoder outputs at terminal 52 vertical extended 
parity which is a product code. Each extended parity 
state is cleared to 0 after it is read. 

Operation of the encoder may be continuous so that 
10 it begins processing the second turbo product code block 
as the final few bits of the first block are being output 
so that there, is no interruption of the data stream. 

For higher dimensional turbo product codes the 
number of encoders and routing/switching devices will 
1-5 increase for the same overall code length, but the 

latency will increase only linearly T " Thus,' a three- 
dimensional turbo product code having the same overall 
product length as a two-dimensional code having 
parameters of, say, 16, 11 by 16, 11 will have a delay of 
20 • only six clock cycles, but will require 1+16+256 = 275 
(16, 11) extended Hamming encoders. 

It will, therefore, be seen that the latency 
introduced by the present invention is substantially 
improved over the prior art device. 
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